When Characteristics of Clinical Trials Require Per-Protocol as Well as Intention-to-Treat Outcomes to Draw Reliable Conclusions: Three Examples.

Under exceptional circumstances, including high rates of protocol non-compliance, per-protocol (PP) analysis can better indicate the real-world benefits of a medical intervention than intention-to-treat (ITT) analysis. Exemplifying this, the first randomized clinical trial (RCT) considered found that colonoscopy screenings were marginally beneficial, based upon ITT analysis, with only 42% of the intervention group actually undergoing the procedure. However, the study authors themselves concluded that the medical efficacy of that screening was a 50% reduction in colorectal cancer deaths among that 42% PP group. The second RCT found a ten-fold reduction in mortality for a COVID-19 treatment drug vs. placebo by PP analysis, but only a minor benefit by ITT analysis. The third RCT, conducted as an arm of the same platform trial as the second RCT, tested another COVID-19 treatment drug and reported no significant benefit by ITT analysis. Inconsistencies and irregularities in the reporting of protocol compliance for this study required consideration of PP outcomes for deaths and hospitalizations, yet the study coauthors refused to disclose them, instead directing inquiring scientists to a data repository which never held the study's data. These three RCTs illustrate conditions under which PP outcomes may differ significantly from ITT outcomes and the need for data transparency when these reported or indicated discrepancies arise.

Ivermectin for Prevention and Treatment of COVID-19 Infection: A Systematic Review, Meta-analysis, and Trial Sequential Analysis to Inform Clinical Guidelines.

BACKGROUND: Repurposed medicines may have a role against the SARS-CoV-2 virus. The antiparasitic ivermectin, with antiviral and anti-inflammatory properties, has now been tested in numerous clinical trials. AREAS OF UNCERTAINTY: We assessed the efficacy of ivermectin treatment in reducing mortality, in secondary outcomes, and in chemoprophylaxis, among people with, or at high risk of, COVID-19 infection. DATA SOURCES: We searched bibliographic databases up to April 25, 2021. Two review authors sifted for studies, extracted data, and assessed risk of bias. Meta-analyses were conducted and certainty of the evidence was assessed using the GRADE approach and additionally in trial sequential analyses for mortality. Twenty-four randomized controlled trials involving 3406 participants met review inclusion. THERAPEUTIC ADVANCES: Meta-analysis of 15 trials found that ivermectin reduced risk of death compared with no ivermectin (average risk ratio 0.38, 95% confidence interval 0.19-0.73; n = 2438; I2 = 49%; moderate-certainty evidence). This result was confirmed in a trial sequential analysis using the same DerSimonian-Laird method that underpinned the unadjusted analysis. This was also robust against a trial sequential analysis using the Biggerstaff-Tweedie method. Low-certainty evidence found that ivermectin prophylaxis reduced COVID-19 infection by an average 86% (95% confidence interval 79%-91%). Secondary outcomes provided less certain evidence. Low-certainty evidence suggested that there may be no benefit with ivermectin for "need for mechanical ventilation," whereas effect estimates for "improvement" and "deterioration" clearly favored ivermectin use. Severe adverse events were rare among treatment trials and evidence of no difference was assessed as low certainty. Evidence on other secondary outcomes was very low certainty. CONCLUSIONS: Moderate-certainty evidence finds that large reductions in COVID-19 deaths are possible using ivermectin. Using ivermectin early in the clinical course may reduce numbers progressing to severe disease. The apparent safety and low cost suggest that ivermectin is likely to have a significant impact on the SARS-CoV-2 pandemic globally.